AUTOMATIC GENERATION OF INFORMATION IDENTIFYING 
AN OBJECT IN A PHOTOGRAPHIC IMAGE 

BACKGROUND OF THE INVENTION 

5 Field Of The Invention 

The invention relates to electronically 
cataloging photographic image data. More 
particularly, the invention relates to automatic 
generation of information identifying an object 
10 taken in a photographic image. 

Description Of The Related Art 

Digital cameras have become increasingly 
prevalent in business environments, and are 

15 replacing film-based cameras. These cameras have 

allowed users to capture images that are stored as 
digital image data in the digital camera. In 
addition, the digital camera generates reference 
data associated with the image such as location 

2 0 data, time data, exposure data and sound data, and 



stores this data along with the image. Some of the 
data can be used to catalog the images once they 
have been downloaded from the camera, so as to allow 
access and retrieval of particular image within a 
stored database of images. 
5 Recently, there have been attempts to 

catalog images automatically based on the identity 
of individuals appearing in the image, while 
avoiding the need to enter such identities manually. 
One setting where referencing photographic images 

10 with particular individuals is needed is where 

pictures are taken of a large number of people, such 
as at weddings, parties, or at vacation locations 
such as resorts or on cruise ships. A system 
currently in use is able to link individuals with 

15 various photographic images in which they appear 

through the use of a colored sticker placed on the 
exterior of the individual's clothing. This system 
comprises photographing a person wearing a sticker 
with either a traditional film camera or a digital 

20 camera. The resulting scanned* prints or digital 

images are uploaded to a database, where they are 
sorted and stored based on the sticker appearing in 
the image. A person can access images that they 
appear in by approaching a kiosk where a camera 

25 reads their sticker and a pattern/ image recognition 

technique retrieves any images in the database that 
contain the same sticker. Images can also be 
retrieved via a personal access code that is 
provided to the person at the same time that they 

3 0 are provided a sticker. 
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Whereas the current system is capable of 
linking specific images with specific individuals, 
it has some disadvantages. Under this system, 
associating an image with a particular individual 
requires that the pattern/ image recognition 
5 technique locate the sticker in each photo. In order 

for this to occur, the sticker must appear in the 
image. If the sticker were covered, or not visible 
at the time a photograph was taken, the system would 
be unable to properly catalog and store the image. 

10 In addition, under certain circumstances, placement 

of the sticker could become an inconvenience to a 
person. For example, if a person with a sticker 
attached to the person's shirt for some reason had 
to put on a coat, the person would have to remove 

15 the sticker from the shirt and place it on the coat. 

When the person no longer needed the coat , the 
sticker would have to be removed from the coat and 
placed back on the shirt . 

2 0 SUMMARY OF THE INVENTION 

The invention addresses the foregoing 
disadvantages by providing automatic generation of 
information that identifies an object (such as a 
2 5 person) captured by a digital camera in a 

photographic image . 

Accordingly, the invention is directed to 
a system and method for electronically referencing 
photographic images. The system and method include 
30 a generator for generating and transmitting a unique 
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identification code, where the unique identification 
code is unique to the specific object in the image. 
The generator transmits the unique identification 
code to a receiver, wherein the receiver is remotely 
located from the generator. Upon receipt, the 
5 unique identification code is verified, and then the 

image corresponding to the unique identification 
code is recorded. The unique identification code is 
encoded in the recorded image data, and then 
transferred to a computer-readable storage medium, 

10 where it is stored in a database. Once transferred, 

the image data can then be securely accessed from 
the database and displayed via a user interface. 

Generating and transmitting a unique 
identification code uniquely identifying the subject 

15 of a photographic image directly to a digital 

camera, and encoding the unique identification code 
in the associated recorded image, eliminates the 
problems associated with systems currently in use 
for cataloging images based on the identify of 

2 0 individuals appearing in the image. 

This brief summary has been provided so 
that the nature of the invention may be understood 
quickly. A more complete understanding of the 
invention can be obtained by reference to the 

25 following detailed description of the preferred 

embodiment (s) thereof in connection with the 
attached drawings . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a drawing illustrating the 
preferred embodiment of the present invention. 

Figure 2 is a flowchart for describing 
5 processing according to the preferred embodiment. 

Figure 3 is a block diagram of the 
internal architecture of a digital camera used in 
the present invention. 

Figure 4 is a block diagram depicting the 
10 preferred embodiment of storing a unique 

identification code together with associated image. 

Figure 5 is a block diagram depicting 
preferred embodiment of the database system in the 
present invention . 
15 Figure 6 is a second embodiment of the 

system in the present invention. 

Figures 7, 8, 9, and 10 are 
representational views of the present invention's 
user interface. 

20 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Figure 1 is a representational view of the 
preferred embodiment of the present invention. As 
seen in Figure 1, generator la is associated with an 
object 1 to be identified in a photographic image, 
such as a person or individual, or such as a 
stationary or movable object (hereinafter "the 
identified object" or "the identified person"). The 
generator la generates and transmits a signal 



25 



30 
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encoding a unique identification code pre-designated 
to correspond and to identify the identified object. 
The generator la, which is preferably a radio 
frequency or infrared transponder, may either by a 
stand-alone item, or can be attached to another 
item, such as a room key. The unique identification 
code is unique to the object in possession of the 
generator la, and is preferably assigned at the time 
the generator la is associated with the object, 
although it can be associated afterwards. For 
example, when a person goes on a cruise, they are 
assigned a specific cabin. The cabin number can be 
used as the unique identification code and is 
associated with the cabin's occupant at the time the 
cabin assignment is made. When the person boards 
the ship, they are provided a cabin key with 
attached generator la, where generator la has been 
programmed with the cabin number. This example is 
not limited to a cruise ship environment, and is 
applicable to other situations. 

The generator la transmits the unique 
identification code to an associated detection unit 
3, which is located in a location remote from the 
generator la. The detection unit 3 of the present 
invention is preferably one component of a digital 
camera 2 which is used to capture an image 
containing the identified object. As shown in 
Figure 3, digital camera 2, includes a camera memory 
medium 13 that is used for capturing and storing 
digital pictures and associated data. The pictures 
are preferably stored in digital camera 2 as camera- 



formatted data that includes both full -resolution 
(e.g., 1024 x 728 pixel) JPEG image file and low- 
resolution thumbnail (e.g., 60 x 80 pixel) JPEG 
image file, in accordance with a camera format 
defined by digital camera 2 . Associated data 
5 including one or more sound files, a picture created 

date, ownership information, and other data can be 
stored with each picture. 

In addition to detection unit 3 and camera 
memory medium 13, digital camera 2 also includes a 

10 microprocessor 14 and a communication unit 4. It 

should be noted that other architectures for digital 
cameras can be used in conjunction with the 
invention and may possess a different and possibly 
more complex architecture . 

15 Digital camera 2 includes lens 15 for 

gathering light waves from objects towards which 
lens is pointed, charge -coupled device 16 for 
translating the received light waves into analog 
signals, analog to digital converter 17 for 

20 converting the analog signals into digital signals, 

and frame memory 18 for storing a single picture 
frame, and a display 19 for display of images and 
information. It should be understood that a digital 
camera with the additional feature of a microphone 

2 5 (not shown) may be used in accordance with the 

invention. 

The above elements are controlled by 
microprocessor 14, which stores a picture from frame 
memory into (possibly removable) camera memory 13. 

3 0 According to the preferred embodiment of the 
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invention, microprocessor 14 stores a capture 
picture in camera memory 13 as a full-resolution 
(e.g., 1024 x 768 pixel) compressed image file and 
as a thumbnail (e.g., 60 x 80 pixel) image file. In 
the preferred embodiment, microprocessor 14 stores 
5 any unique identification codes detected by 

detecting unit 3 from one or more generators la in a 
manner that associates the unique identification 
code or codes with the corresponding image file that 
contains the identified object or objects. 

10 Digital camera 2 can be connected to a 

computer 5 through a cable or other form of 
connection via communication unit 4. Communication 
unit 4 is controlled by microprocessor 14 . Although 
communication unit 4 is preferably a simple serial 

15 port, any other method or functionality connecting 

digital camera 2 to computer 5, such as infrared, 
USB, or the like, may be used in practicing the 
invention. Once digital camera 2 is functionally 
connected to computer 5, the files and data, 

2 0 including the unique identification code, for each 

picture stored in digital camera 2 are available for 
download onto computer 5, where they are stored on a 
computer-readable storage medium 19. According to 
the invention, this uploading can be performed via a 

2 5 camera driver executing on computer 5 from an 

application program. 

It should be understood that -computer 5 as 
described in the invention could be any type of 
computer, such as a portable personal computer, a 

3 0 digital assistant, or a desktop personal computer. 
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After the files and data have been 
downloaded onto computer 5, the files and data are 
transferred from computer 5 to a database 8 which 
preferably is located on a remote computer system 7 
via computer's 5 input/output interface port 6. Any 
5 method of functionality connecting computer 5 with 

remote computer system 7, such as a local or 
wireless network, may be used in practicing the 
invention . 

Once the files and data have been stored 

10 in database 8, they can be accessed and displayed 

via a user interface 9 using the associated unique 
identification code . 

Orders for visual prints of the images are 
placed using user interface 9 and received by 

15 computer system 7. Computer system 7 then transmits 

the request to a remote server 10 . Remote server 10 
creates the requested visual prints using standard 
equipment available in the industry, such as photo 
printer 11. The resulting prints would then be 

20 shipped to the requestor using the requestor's 

personal information stored in database 8 . In an 
alternative embodiment, creation of a compact disc, 
using standard compact disc burner 12, containing 
the images can be requested either in place of or in 

25 addition to visual prints. In yet another 

embodiment, instead of transmitting the request for 
visual prints to remote server 10, computer system 7 
creates the requested visual prints using photo 
printer 2 6 and compact disc burner 27. 
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Figures 7 , 8, 9, and 10 are 
representational views of the present invention's 
user interface. Figure 7 depicts the initial screen 
and presented to the user upon accessing the system. 
From this screen, the user is presented with the 
5 option of displaying their photographs or ordering 

their photographs. In order to access either 
option, the user is prompted to enter a password and 
an identification number, as depicted in Figure 8. 
In the preferred embodiment, the password is the 

10 passenger's last name and the identification number 

is the unique identification code that was assigned 
to the passenger. If the user chose to display the 
photographs, after both the password and 
identification number are entered and validated, the 

15 system retrieves all photographs stored on the 

database associated with the inputted identification 
number and displays them, as shown in Figure 9 . The 
user is also given an option to switch to the 
ordering screen, where the passenger is given the 

2 0 option of ordering prints for a single or multiple 

photographs, with the order processed as previously 
described. If the user initially chooses the order 
option, the user is prompted to enter a password and 
identification number as previously described. 

25 After both the password and identification number 

are entered and validated, the system retrieves all 
photographs stored on the database associated with 
the inputted identification number and provides the 
user with various ordering options (e.g., size of 

30 prints, number of prints), as depicted in Figure 10. 
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In another embodiment, computer 5 
interfaces with remote server 10 directly, and 
orders for visual prints and compact discs are made 
directly from computer 5 . 

In yet another embodiment, after the files 
5 and data have been downloaded from digital camera 2 

onto computer 5, computer transmits the unique 
identification code to remote computer system 7, 
where the passenger name associated with the 
transmitted unique identification code is retrieved 

10 from database 8 and transmitted to computer 5. 

Computer 5 then transmits the passenger name back to 
digital camera 2, where it is displayed for the 
photographer. 

Figure 6 depicts another embodiment of the 

15 present invention, in which reference numbers 

similar to those in Figure 1 have been assigned. In 
this embodiment, detection unit 103 is not a 
component of camera 102, but is a stand-alone 
component. Both camera 102 and detection unit 103 

20 are connected to computer 105 via a cable or other 

form of connection. Computer 105 is connected to 
the remote computer system 107 via cable or other 
form of connection. In yet another embodiment, 
computer 105 is connected to remote server 110. In 

25 still another embodiment , computer 105 is connected 

to both remote computer system 107 and remote server 
110 . 

Figure 2 is a flowchart for describing 
electronic cataloging of photographic image data 
3 0 according to the invention. As described above, the 
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invention is directed to automatically linking 
photographic images to the correct corresponding 
objects in an environment where numerous photographs 
are taken of a large number of different identified 
objects. One such environment is a cruise ship. 
5 The cruise ship setting will be used as an 

illustrative example to describe the preferred 
embodiment of the invention. It should be 
understood that the invention could be practiced in 
any number of settings and is not limited to the 

10 cruise ship setting. 

Briefly, a unique identification code is 
assigned to a cruise ship passenger, and the 
passenger is provided a generator that generates and 
transmits a signal encoding the assigned unique 

15 identification code. When the cruise ship's 

photographer takes the passenger's picture, the 
passenger's generator transmits the unique 
identification code to a corresponding detection 
unit in the photographer's camera. The photographer 

20 verifies that the unique identification code 

corresponds to the passenger, takes a photograph of 
the passenger, and the received unique 
identification code is automatically encoded into 
the resulting digital image. The photographer 

2 5 downloads the image into a host computer for 

temporary storage, and at some later time, transfers 
the image into a database located on the ship's 
computer system. The passenger, and photographer, 
can then access and display the images from a 

3 0 location remote from the ship's computer system. 
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In more detail, in step S201, a passenger 
is assigned a unique identification code. The code 
could be any sequence of alphanumeric values, but 
preferably, is the passenger's room number. The 
generator la is programmed with the assigned unique 
5 identification code and given to the passenger. 

Preferably, the generator la would be attached to 
some object the passenger would possess for the 
duration of the cruise, like a room key. 

In step S202, when a cruise ship 

1.0 photographer is set to take a passenger's picture, 

the passenger's generator la transmits the 
passenger's unique identification code to a 
detection unit in the photographer's camera. 

Step S203 optionally allows verification 

15 that the received unique identification code 

corresponds to the passenger whose picture is about 
to be taken. Verification can occur in several 
ways. One method comprises the camera displaying 
the passenger's name upon receipt of the unique 

2 0 identification code, and the photographer orally 

verifying the information by asking the passenger's 
name . 

After verification occurs in Step S203 and 
the picture is taken in Step S204, the received 
2 5 unique identification code is encoded in the 

resulting image's associated data using the DIG35 
standard as further described herein, and the image 
and data are stored in camera memory medium 13 in 
step S205. 
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Once the photographer is ready, in step 
S206, the image and associated data is transferred 
from the camera to computer 5 for temporary storage. 
As described above, the transfer is performed by the 
camera's 2 communication unit 4, and is accomplished- 
5 by any method that functionally connects digital 

camera 2 to computer 5. Once the functional 
connection is established, the files and data for 
each picture stored in digital camera 2 are 
available for upload onto computer 5. 

10 After the files and data for each picture 

have been transferred to computer 5, in step S 2 07 
the photographer at some later time, transfers the 
files and data from computer 5 to database 8 located 
on the cruise ship's computer system 7, the 

15 structure of database 8 further described herein. 

In step S208, after the files and data for 
each picture have been downloaded into database 8, 
they can be accessed and displayed via a user 
interface 9 using the unique identification code as 

2 0 further described herein. Access using the unique 

identification code allows for secure viewing of the 
image. In the preferred embodiment access and 
display of the files and data is performed from a 
location remote from where the data and files are 

25 stored, such as the passenger's room. It should be 

noted that any other method of displaying the files 
and data may be used in accordance with the 
invention. Finally, in step S209, the images are 
printed,, stored on a compact disc, or both. 
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Figure 4. depicts the preferred embodiment 
of embedding the unique identification code in the 
associated image using the DIG35 standard. DIG35 
refers to a standard set of metadata for digital 
images resulting from a broad collaboration of 
5 imaging and technology industry participants. As 

shown in Figure 4, the DIG3 5 metadata consists of 
five logical blocks, where each block defines a 
unique aspect . of the image. One of these unique 
logical blocks is Content Description 20. As its 

10 name indicates, this particular metadata block 

contains various sections that define the content of 
an image. In one preferable aspect of the 
invention, person field 21 is added to content block 
21 of the meta-data. The Person 21 description 

15 contains sub- fields that can be used to describe the 

subject or subjects within an image. One sub- field, 
Property 22, can be used to specifically identify 
the subject or subjects within an image. It is this 
sub-field where the passenger's unique 

20 identification code is automatically embedded by 

microprocessor 14 of camera 2 . 

In another embodiment, the passenger's 
name, which was transmitted to camera 2 as described 
in a previous embodiment, is also embedded into the 

25 Property 22 sub-field. In yet still another 

embodiment, multiple objects 1, 2 5 are present in a 
single photographic image with each object 
possessing its own generator la, 25a that transmits 
a unique identification code for each object. In 

3 0 this embodiment, since the maximum size of the 
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Property 22 sub-field is unbounded, all of the 
various unique identification codes are embedded 
into the Property 22 sub- field. 

The preferred structure of database 8 is 
shown in Figure 5. Image Table 24 contains the 
images and the images' respective unique 
identification code downloaded from computer 5. One 
Image Table 24 is created for each respective unique 
identification code present in the downloaded 
Property 22 sub- field. Personal Information Table 
23 contains personal information for each cruise 
ship passenger. The fields of this table include 
items such as the passenger's name, address, contact 
number, and electronic mail address. In addition, 
the passenger's unique identification code is also 
stored in this table. The unique identification 
code in Personal Information Table 23 is the same 
field as the unique identification code in Image 
Table 24. This common field is used to link the two 
tables together. This link is what enables 
passengers to access and display their images via 
user interface 9 . 

While the invention is described above 
with respect to what is currently considered its 
preferred embodiment, it is to be understood that 
the invention is not limited to that described 
above. To the contrary, the invention is intended 
to cover various modifications and equivalent 
arrangements within the spirit and scope of the 
appended claims . 
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